sine and cosine
The Tabular Foundation Model TabPFN Outperforms Specialized Time Series Forecasting Models Based on Simple Features
Hoo, Shi Bin, Müller, Samuel, Salinas, David, Hutter, Frank
Foundation models have become popular in forecasting due to their ability to make accurate predictions, even with minimal fine-tuning on specific datasets. In this paper, we demonstrate how the newly released regression variant of TabPFN, a general tabular foundation model, can be applied to time series forecasting. We propose a straightforward approach, TabPFN-TS, which pairs TabPFN with simple feature engineering to achieve strong forecasting performance. Despite its simplicity and with only 11M parameters, TabPFN-TS outperforms Chronos-Mini, a model of similar size, and matches or even slightly outperforms Chronos-Large, which has 65-fold more parameters. A key strength of our method lies in its reliance solely on artificial data during pre-training, avoiding the need for large training datasets and eliminating the risk of benchmark contamination.
- Europe > Germany > Baden-Württemberg > Freiburg (0.04)
- North America > Trinidad and Tobago > Trinidad > Arima > Arima (0.04)
- Europe > Germany > Baden-Württemberg > Tübingen Region > Tübingen (0.04)
Celestial Machine Learning: Discovering the Planarity, Heliocentricity, and Orbital Equation of Mars with AI Feynman
Khoo, Zi-Yu, Rajiv, Gokul, Yang, Abel, Low, Jonathan Sze Choong, Bressan, Stéphane
Can a machine or algorithm discover or learn the elliptical orbit of Mars from astronomical sightings alone? Johannes Kepler required two paradigm shifts to discover his First Law regarding the elliptical orbit of Mars. Firstly, a shift from the geocentric to the heliocentric frame of reference. Secondly, the reduction of the orbit of Mars from a three- to a two-dimensional space. We extend AI Feynman, a physics-inspired tool for symbolic regression, to discover the heliocentricity and planarity of Mars' orbit and emulate his discovery of Kepler's first law.
- North America > United States > New York > New York County > New York City (0.14)
- Asia > Singapore (0.05)
- North America > United States > Massachusetts > Suffolk County > Boston (0.04)
- (3 more...)
Predicting the performance of hybrid ventilation in buildings using a multivariate attention-based biLSTM Encoder-Decoder neural network
Chaudhary, Gaurav, Johra, Hicham, Georges, Laurent, Austbø, Bjørn
Hybrid ventilation is an energy-efficient solution to provide fresh air for most climates, given that it has a reliable control system. To operate such systems optimally, a high-fidelity control-oriented modesl is required. It should enable near-real time forecast of the indoor air temperature based on operational conditions such as window opening and HVAC operating schedules. However, physics-based control-oriented models (i.e., white-box models) are labour-intensive and computationally expensive. Alternatively, black-box models based on artificial neural networks can be trained to be good estimators for building dynamics. This paper investigates the capabilities of a deep neural network (DNN), which is a multivariate multi-head attention-based long short-term memory (LSTM) encoder-decoder neural network, to predict indoor air temperature when windows are opened or closed. Training and test data are generated from a detailed multi-zone office building model (EnergyPlus). Pseudo-random signals are used for the indoor air temperature setpoints and window opening instances. The results indicate that the DNN is able to accurately predict the indoor air temperature of five zones whenever windows are opened or closed. The prediction error plateaus after the 24th step ahead prediction (6 hr ahead prediction).
- Construction & Engineering > HVAC (0.90)
- Energy > Oil & Gas > Upstream (0.35)
Fourier Series. Fourier Transformation
The world has been shifting towards automation and behind every automation process, there is mathematics -Probability, Linear Algebra, Calculus, Statistics, Discrete Mathematics, etc. This is the basic question that comes into our mind and we just refer it to as something to do with graphs, sines, and cosines. But Fourier has more than that to offer us. To understand Fourier Series, let's first understand what is Periodic Function! Its importance comes later in the article.
Demystifying artificial intelligence
Computers do what we tell them to do. Any talk of computers doing things they weren't programmed to do is only a way of speaking. It's a convenient shorthand when used properly, misleading mysticism when used improperly. But of course the computer was programmed to print the number 168. It just wasn't directly programmed to do so.